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Abstract 

The problem Hamiltonian of the adiabatic quantum algorithm for the maximum-weight independent set 
problem (MIS) that is based on the reduction to the Ising problem (as described in |6|) has flexible parameters. 
We show that by choosing the parameters appropriately in the problem Hamiltonian (without changing the 
problem to be solved) for MIS on CK graphs [7], we can prevent the first order quantum phase transition flU 
and significantly change the minimum spectral gap. We raise the basic question about what the appropriate 
formulation of adiabatic running time should be. We also describe adiabatic quantum algorithms for Exact 
Cover and 3SAT in which the problem Hamiltonians are based on the reduction to MIS. We point out that 
the argument in Altshuler et al. |2| that their adiabatic quantum algorithm failed with high probability for 
randomly generated instances of Exact Cover does not carry over to this new algorithm. 

1 Introduction 

Adiabatic quantum computation (AQC) was proposed by Farhi et al. fTT\ in 2000 as an alternative quantum 
paradigm to solve NP-hard optimization problems, which are believed to be classically intractable. Later, it was 
shown by Aharonov et al. lUl that AQC is not just limited to optimization problems, and is polynomially equiva- 
lent to conventional quantum computation (quantum circuit model). A quantum computer promises extraordinary 
power over a classical computer, as demonstrated by Shor f2T\ in 1994 with the polynomial quantum algorithm 
for solving the factoring problem, for which the best known classical algorithms are exponential. Just how 
much more powerful are quantum computers? In particular, we are interested in whether an adiabatic quantum 
computer can solve NP-complete problems more efficiently than a classical computer. 

Unlike classical computation or conventional quantum model in which an algorithm is specified by a finite 
sequence of discrete operations via classical/quantum gates, the adiabatic quantum algorithm is continuous. It has 
been assumed (see Section|2]for more discussion) that, according to the adiabatic theorem, the dominant factor of 
the adiabatic running time (ART) of the algorithm scales polynomially with the inverse of the minimum spectral 
gap gmin of the system Hamiltonian (that describes the algorithm). Therefore, in order to analyze the running time 
of an adiabatic algorithm, it is necessary to be able to bound gm\n analytically. However, gm\n is in general difficult 
to compute (it is as hard as solving the original problem if computed directly). Rigorous analytical analysis of 
adiabatic algorithms remains challenging. Most of studies have to resort to numerical calculations. These include 
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numerical integration of Schrodinger equation lfT2l l5l. eigenvalue computation (or exact diagonization) ll28l 1211 . 
and quantum Monte Carlo (QMC) technique 1251 l26l . However, not only are these methods limited to small sizes 
(as the simulations of quantum systems grow exponentially with the system size), but also little insight can be 
gained from these numbers to design and analyze the time complexity of the algorithm. 

Perhaps, from the algorithmic design point of view, it is more important to unveil the quantum evolution 
black-box and thus enable us to obtain insight for designing efficient adiabatic quantum algorithms. For this 
purpose, we devise a visualization tool, called Decomposed State Evolution Visualization (DeSEV). Through 
the aid of this tool, we constructed a family of instances of MIS, called CK graphs [7]. The numerical results of 
an adiabatic algorithm for MIS on these graphs suggested that gmm is exponentially small and thus the algorithm 
requires exponential time. These results were then explained by the first order quantum phase transition (FQPT) 
in L4J- Since then, there have been some other papers (Altshuler et al., [2] ; Farhi et al., [14J; Young et al., ll26l : 
Jorg et al., lfT8l[T9l ) investigating the same phenomenon, i.e., first order quantum phase transition. In particular, 
Farhi et al. in lfT4l suggested that the exponential small gap caused by the FQPT could be overcome (for the 
set of instances they consider) by randomizing the choice of initial Hamiltonian. In this paper, we show that by 
changing the parameters in the problem Hamiltonian (without changing the problem to be solved) of the adiabatic 
algorithm for MIS on CK graphs, we prevent the FQPT from occurring and significantly increase gmin- We do 
so by scaling the vertex-weight of the graph, namely, multiplying the weights of vertices by a scaling factor In 
order to determine the best scaling factor, we raise the basic question about what the appropriate formulation of 
adiabatic running time should be. 

We also describe adiabatic quantum algorithms for Exact Cover and 3SAT in which the problem Hamiltonians 
are based on the reduction to MIS. In [2], Altshuler et al. claimed that a particular adiabatic quantum algorithm 
failed with high probability for randomly generated instances of Exact Cover. They claimed that the correctness 
of their argument did not rely on the specific form of the problem Hamiltonian for Exact Cover We demonstrate 
an adiabatic algorithm for Exact Cover in which the problem Hamiltonian is based on the reduction to MIS that 
questions the generality of this claim. 

This paper is organized as follows. In Section |2] we review the adiabatic quantum algorithm, and adiabatic 
running time. In Section[3j we recall the adiabatic quantum algorithm for MIS based on the reduction to the Ising 
problem. In Section [4j we describe the visualization tool DeSEV and the CK graphs. We show examples of 
DeSEV on the MIS adiabatic algorithm for CK graphs. In Section|5] we describe how changing the parameters 
affects gmin, and raise the question about ART. In Section |6j we describe adiabatic algorithms for Exact Cover 
and 3SAT that are based on MIS reduction. We conclude with the discussion in Section [T] 

2 Adiabatic Quantum Algorithm 

An adiabatic quantum algorithm is described by a time-dependent system Hamiltonian 

n{t) = (1 - S(i))^init + KO'^problem 

for t £ [0, T], s(0) = 0, s(T) = 1. There are three components of (1) initial Hamiltonian: ?^(0) = ?^init; 
(2) problem Hamiltonian: n{T) = T^probiem; and (3) evolution path: s : [0, T] — > [0, 1], e.g., s{t) = ^. n{t) 
is an adiabatic algorithm for an optimization problem if we encode the problem into the problem Hamiltonian 
^problem such that the ground state of ^problem corresponds to the answer to the problem. The initial Hamiltonian 
V.\n\t is chosen to be non-commutative with 'Hprobiem and its ground state must be known and experimentally 
constructable, e.g., 'Hinitai = — J2ieV{G) '^i^f- Here T is the running time of the algorithm. According to 
the adiabatic theorem, if ^(t) evolves "slowly" enough, or equivalently, if T is "large" enough (see Adiabatic 
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Running Time below) the system remains in the ground state of'H{t), and consequently, ground state of'H{T) = 
^problem gives the solution to the problem. 

Notice that given a problem, there are three components (initial Hamiltonian, problem Hamiltonian, and 
evolution path) that specify an adiabatic algorithm for the problem. A change in an component (e.g. initial 
Hamiltonian) will result in a different adiabatic algorithm for the same problem. 

In this paper, we fix the evolution path by the linear interpolation function s{t) = ^. Hereafter, we describe 
an adiabatic algorithm by the re-parametrized Hamiltonian 

T-L{s) = (1 — s)'H\„\t + sT^problem 

where s G [0, 1], with understanding that s{t) = t/T. Furthermore, throughout this paper, we fix the initial 
Hamiltonian to be T^init = — X^iev(G) '^i- When it is clear from context, we also refer to the problem Hamilto- 
nian as the adiabatic algorithm for the problem. 

Adiabatic Running Time. In their original work f\V\, the running time of the adiabatic algorithm is defined to 
be the same as the adiabatic evolution time T, which is given by the adiabatic condition of the adiabatic theorem. 
However, this definition is under the assumption of some physical limit of the maximum energy of the system (see 
e.g., IITtII ). and is not well-defined from the computational point of view, as observed by Aharonov et al. HI. They 
re-define ART(?^) as T ■ maxg | |?^(s)| |, taking into the account of the time-energy trade-off in the Schrodinger's 
equatioi|^ 

On the other hand, given the extensive work on the rigorous proofs of the adiabatic theorem, it is interesting 
(if not confusing) that many different versions of the adiabatic conditions have been recently proposed. These 
include |l2l|3l[3B|32l|Ml3l|371[3l|35l[Mll3linth quantum physics community, and lEOl HI H in the 
computer science community. Most of these studies suggest that ART scales polynomially with the inverse of 
the spectral gap of the system Hamiltonian, which is sufficient when one is interested in the coarse computational 
complexity of algorithms, namely, the distinction between polynomial and exponential running time. 

However, from both the practical and algorithmic point of view, it is important to have a more precise formu- 
lation of ART. First, this is because the specification of the adiabatic evolution time T is required in an adiabatic 
algorithm, and therefore a tight and simple upper bound is desired. Second, we are interested in the actual time 
complexity of the algorithm, and not just the polynomial vs. exponential distinction. It is necessary to have a 
more precise formulation of ART such that basic algorithmic analysis can be carried out. Third, at this stage 
of research, it is particularly important to have such a formulation because the spectral gap, which plays the 
dominating role in the formulation of ART, is difficult to analyze. All current efforts on the spectral gap analysis 
resort to numerical studies, and that means the studies are restricted to small problem sizes only. Therefore, to 
gain insight into the time complexity of algorithms from these small instances, it is important that the formula- 
tion of ART applies to small sizes. So what is the appropriate formulation of ART? What should the adiabatic 



condition(s) be? In Section 5.2 we compare three closely related versions and raise the question about what the 



appropriate adiabatic running time should be. 



3 An Adiabatic Algorithm for MIS 

In this section, we recall the adiabatic algorithm for MIS that is based on the reduction to the Ising problem, as 
described in [6]. First, we formally define the Maximum-Weight Independent Set (MIS) problem (optimization 
version): 

' Namely, i^^^T^ = ^ ' ^(■s)l^(s)) = ^ ' KH{s)\-ip{s)) where if > is a constant. 
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Input: An undirected graph G(= (V(G), E(G))), where each vertex i G V(G) = {l,...,n} is weighted 
by a positive rational number Cj 

Output: A subset S C V(G) such that S is independent (i.e., for each i,j E V(G), i 7^ j, E(G)) 
and the total weight of S" (= X^jgg Cj) is maximized. Denote the optimal set by mis(G). 

There is a one-one correspondence between the MIS problem and the Ising problem, which is the problem 
directly solved by the quantum processor that implements 1/2-spin Ising Hamiltonian. We recall the quadratic 
binary optimization formulation of the problem. More details can be found in [i6l . 

Theorem 3.1 (Theorem 5.1 in ||6l). If Jij > minjcj, Cj}for all ij € E(G), then the maximum value of 

. . . ^Xn) — ^ ^ CiXi ^ ^ JijXiXj (1) 

ieV(G) iieE(G) 

is the total weight of the MIS. In particular if Jij > minjcj, Cj} for all ij G E(G), then mis(G) = {i G V(G) : 
X* = 1}, where {x\,...,x*^) = arg max(^^^ ^^.^)g|o,i}n . . . , j;„). 

Here the function y is called the pseudo-boolean function for MIS. Notice that in this formulation, we only 
require Jy > minjcj, Cj}, and thus there is freedom in choosing this parameter. In this paper we will show how 
to take advantage of this. 

By changing the variables (xj = ^-^), it is easy to show that MIS is equivalent to minimizing the following 
function, known as the Ising energy function: 

£{si,...,Sn) = ^ hiSi+ ^ JijSiSj, (2) 

ieV(G) iieE(G) 
which is the eigenfunction of the following Ising Hamiltonian: 

Rising = ^ hia- + ^ Jijf^i^^j (3) 
ieV(G) ijeE(G) 

where hi = Ejenbr(i) -^ij " ^q, nbr(i) = {j : ij G E(G)}, for i G V(G). 

That is, an adiabatic algorithm for MIS in which the problem Hamiltonian is Rising is described by the 
following system Hamiltonian: 

Tiis) = (1 — s)'H]rt\t + seising 

where s G [0, 1] with the assumption that s{t) = t/T. If T is sufficiently large according to the adiabatic theorem, 
then the ground state of ^(1), say \xlx2 ■ ■ ■ x^) , corresponds to the maximum- weight independent set, namely 
mis(G) = {i : X* = of\ 

4 DeSEV and CK Graphs 

In this section, we describe a visualization tool, called Decomposed State Evolution Visualization (DeSEV), 
which aims to "open up" the quantum evolution black-box from a computational point of view. Consider the 
above adiabatic algorithm for MIS. Recall that according to the adiabatic theorem, if the evolution is slow enough, 

^Notice we use Xi = instead of Xi = -^-^^ . 
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the system remains in the instantaneous ground state. Let \il^{s)) be the ground state of ^(s), for s G [0, 1]. For 
a system of n-qubits, \ip{s)) is a. superposition of 2" possible computational states, namely, 

IV'('S)) = ^ a:r{s)\x), where ^ \ax{s)\^ = 1. 

xe{0,l}" a;e{0,l}" 

For example, we have the initial ground state lipiO)) = -^j^ X^xejo i}" 1^)' which is uniform superposition of 
all 2" states, while the final ground state = . . . x* ), corresponding to the solution state. A natural 

question is: what are the instantaneous ground states \ip{s)), for < s < 1, like? In particular, we would like to 
"see" how the instantaneous ground state evolves? A naive solution would be to trace the 2" amplitudes Ox- The 
task becomes unmanageable even for n = 10, which has 1024 amplitudes, even thouhg many may be negligible 
(close to zero). 

To make the "visualization" feasible, we introduce a new measure r^. Suppose that ^(1), has (m + 1) < 2" 
distinct energy levels: £'o < £^1 < . . . < E^- For < < m, let Dk = {x e {0, 1}" : 'H{l)\x) = Ek\x)} 
be the set of (degenerate) computational states that have the same energy level Ek (with respect to the problem 
Hamiltonian 'H(l)), and define 

Tkis) = \ax{s)\\ 
xeDk 

In other words, Tk{s) is the total percentage of (computational) states of the same energy level Ek participating 
in \Tp{s)). The idea is now to trace instead of Ux- Here we remark that are defined for any eigenstate \ip) 
and not just for the ground state. 

For our purpose, we constructed a special family of vertex-weighted graphs for the MIS problem, called CK 
graphs [7]. We designed the problem instances such that the global minimum is "hidden" in the sense that there 
are many local minima to mislead local search based algorithms. Note that the size of th smallest instances needs 
to be necessarily smaller than 20 as we are relying on the eigenvalue computation (or exact diagonization) to 
compute Tj.. 

CK Graph Construction. Let r,g be integers, and wa, wb be positive rational numbers. Our graphs are 
specified by these four parameters. There are two types of vertices in the graph: vertices of a 2(7-independent 
set, denoted by Va, and vertices of g r-cliques (which form maximal independent sets), denoted by Vb- The 
weight of vertex in Va (Vb resp.) is wa (wb resp.). The connections between Va and Vb- partition the 2g 
vertices in Va into g groups of 2. Label the g r-cliques such that each group is adjacent to all but one (the same 
label) r-cliques. Note if u;^ < 2w^, then we have Va forming the (global) maximum independent sets of weight 
2gwA, while there are (local) maximal independent set of weight gwB- See Figure [T]f or an example of a graph 
for r = 3 and g = 3. 

4.1 DeSEV for the MIS Adiabatic Algorithm on a 15-vertex CK Graph 

In the section, we fix the CK graph with r = 3, g' = 3 as illustrated in Figure [T] We set wa = 1, and consider 
1 < Wb < 2. The graph G consists of 15 vertices: Va = {1, • • ■ , 6} forms the maximum-weight independent set 
of weight 6; while Vb, consisting of 3 groups of 3 triangles: {7, 8, 9}, {10, 11, 12}, and {13, 14, 15}, forms 3^ 
maximal independent sets of weight 3wb < Q- 

According to Eq.Q, the problem Hamiltonian (and thus the adiabatic algorithm) for MIS on G is 

ni=Y, (6J - 2)< + ^ (6 J - 2wB)af + J ^ C7| (4) 
jgVa ieVs ueE(G) 

Here we fix Jij = J = 2 > wb for all ij G E(G). 
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Figure 1: (a) A CK graph for r = 3 and g = 3. The graph consists of 15 vertices: Va = {1> • • • , 6} forms an 
independent set of size 6, while Vb, consisting of g{= 3) groups of r(= 3) triangles: {7,8,9}, {10, 11, 12}, 
and {13, 14, 15}, forms 3'^ independent sets of size 3. The graph is connected as follows. The 6 vertices in 
Va are divided into 3 groups: {1,2}, {3,4}, and {5,6}. The vertices in each group are adjacent to vertices 
in two groups of three triangles in Vb (as illustrated by different colors), (b) The drawing of the graph with 
explicit connections. The weight of a vertex in Va (Vb resp.) is wa {wb resp.). We set wa = 1, and consider 
1 < Wb < 2. For explanation purpose, we represent a vertex in Va by a •, and a vertex in Vb by a A. Therefore, 
Va = {•,»,•,•,•,•,}, forms the MIS of weight 6; while {A, A, A} is a maximal independent set of weight 
3wb{< 6). 



Notation on represent the computational states. For a computational state \x1x2 ■ . . Xn) where Xj € {0, 1}, 
we adopt the zero position representation, namely, represent it by \i1i2 ■ ■ - ik) where Xj = if and only if j = it 
for some t. That is, we represent |000000111111111) (the solution state) by 1 123456). Further, we use a • to 
denote a vertex in V^, a A for a vertex in Vb- That is, the solution state is now represented by | • • • • • •), while 

I AAA), corresponding to a local maximal independent set of weight 3^^ with one vertex from each triangle. 

Maximum vs Minimum. The maximum of MIS corresponds to the minimum of the Ising energy. For explana- 
tion purpose, instead of referring to the energy values of the Ising Hamiltonian, we will refer to the values of MIS 
given by the pseudo-boolean function y in Eq.([T]) by "(-)energy", where "(-)" is to indicate the reverse ordering. 

Example. The (-)energy of !••••••) is 6; while | A AZWX) is Aw b — J, where ZW\ represents two connected 

vertices from Vb, e.g. vertex 7 and 8 in Figure[T] 

See Figure [2] for the DeSEV of the the ground state of the adiabatic algorithm with Tii in Eq.Q as the 
problem Hamiltonian for wb = 1-5 and 1.8. 

4.2 FQPT and Perturbation Estimation 

To gain better understanding, we vary the weights of vertices: fix wa = 1, while varying wb from 1 to 1.9 with 
a step size of 0.1. That is, we fix the global maximum independent set, while increasing the weight of the local 



6 



maximum. As the weight of wb increases, the minimum spectral gaps get smaller and smaller (indeed, from 
10-1 to 10"^ as Wb changes from 1 to 1.9). See Table[2]in Appendix A. 

This was consequently explained by the FQPT in [4|. By FQPT, here we mean that there is a level anti- 
crossing between two states as illustrated in Figure |3] The minimum spectral gap (^min) and the position (s*) 
were then estimated based on the assumption of the level anti-crossing between the global minimum and the 
local minima using perturbation method. In particular, grrt\n was estimated by the tunneling amplitude between 
the global minimum and the local minima. The formula so derived involves combinatorial enumeration of the all 
possible paths between local minima and the global minimum, and suggested i^min is exponentially (in terms of 
the problem size) small. See also EIHIElllH for more explanation on the FQPT and the level anti-crossing. 



5 Varying Parameters in the Problem Hamiltonian for MIS 

In this section, we show that by changing the parameters in the problem Hamiltonian for MIS on CK graphs, the 
FQPT no longer occurs and we can significantly increase ^min- 



Recall that in the pseudo-boolean formulation of MIS as in Theorem 3.1 the requirement for Jij is at least 
min{ Cj,Cj}, for each ij G E(G). For simplicity, we consider the simplest case in which Jij = J for all 
ij £ E(G). In other words, we have the corresponding problem Hamiltonian: 

ni= {diJ - 2ci)at + Jafa'j 

i&y{G) iieE(G) 

where di is the degree of vertex i G V(G'). 

The natural question is how does the ART change when we vary J? Note that it is not sufficient to consider 
only the minimum spectral gap change (as almost all the other works on adiabatic quantum computation did) 
because by increasing J, the maximum energy of the system Hamiltonian also increases. Instead, in order to 
keep the maximum energy of the system Hamiltonian comparable, we keep J fixed and vary Cj instead, namely 
multiplying all weights q by a scaling factor, say \/k,for k > 1, which does not change the original problem to 
be solved. We remark that this is equivalent to multiplying J by k, and then multiply the problem Hamiltonian 
by (1 / k). The details and more general case can be found in lUl. 

That is, we consider the following (scaled) problem Hamiltonian 

^fc = V {Jdi - 2ci/k)at + V J^f (5) 



ieV(G) iieE(G) 



where A; > 1 is the scaling factor. 



5.1 Minimum Spectral Gap ^^in Without FQPT 

The DeSEV of T-Li and TiiQ (k = 10) is shown in Figure|4]and Figure|5] The anti-crossing between the global 
minimum and the local minima (for fc = 1) no longer occurs for k = 10, and gm\r, increases from 1.04 x 10"^ 
to 0.145. Notice that the change in the lowest few excited energy levels: for k = 1, the lowest few excited 
states (beyond the first excited state) of the problem Hamiltonian is mainly the superposition of states from Vb 
(A) (which constitutes the local minima); while these states of the scaled (k = 10) problem Hamiltonian is 
mainly the superposition of states from Va(«) (which constitutes the global minimum). The DeSEV of T-L^ for 
k = 1,2, 3, 5, 10, 50 is shown in Figure |6] 
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In 0, based on the FQPT assumption, we estimate gmin (for Hi) by the tunneUng amplitude between the 
local minima and the global minimum, which suggests that gm\n is exponentially small. However, for k = 10, 
from our numerical data and DeSEV in Figure [4| we see that the FQPT (that causes gmm to be exponentially 
small) no longer occurs, and gm\n increases significantly (from 10^^ to 0.145). This seems to suggest that (/min 
to be polynomially small instead. We are currently investigating how to analytically bound or estimate gmin of 
"Hfc for a general CK graph of size n. We remark here that the perturbation method is still valid (in fact, as we 
increase k, we also increase the minimum spectral gap position s* 1 (see [8| for the proof)), however we can 
no longer assume that ^min can be approximated by the tunneling amplitude between the two (localized) states. 



5.2 Scaling Factor and ART 

In this section, we discuss what the good scaling factor should be, and how it affects the ART. To address this 
question, we need an appropriate formulation for ART. We point out that it is not sufficient to just consider 
gmin, but the matrix element of the time derivative of the Hamiltonian also matters. In particular, we adopt the 
following three formulations, which are related to the widely used traditional condition: 



(*) 



ARTi(^) = "'^'"X"^^'^ maxo<.<i||?^|| 

ART2CH) = ^maxo<,<i||-H||, where^^in = ^i(s*)-So(s*) 
ART3(-H) = maxo<s<i maxo<s<i 



where Ai{s) = \{Ei{s)\^\Eq{s))\ is the matrix element of the time derivative Hamiltonian at time s, and 
'H{s)\Ei{s)) = Ei{s)\Ei{s)). See Table[T]for the numerical comparisons. 

From Tabl^ we see that gmin increases as k increases from 1 to 10, however, decreases from 10 to 50 (even 
though it is still much larger than k = 1). The latter, perhaps, can be explained by the following: as k increases, 
the difference between the low energy levels decreases, and becomes dominate for k > 10. We remark that the 
optimal value for k seems to depend only on the vertex weights (for which J depends on), and independ of the 
problem size. By increasing the scaling factor, we also increase the precision (or dynamic range) requirement 
for representing the parameters (hi & Jij) in the problem Hamiltonian, which is one of the important physical 
resources. 

The three versions of ART look similar, and indeed they coincide for some Hamiltonians (e.g. for k = 1). 
However, they can be very different for the large k. The main reason is that the matrix element M-{s) can be 
extremely small at the minimum spectral gap position s*. For example, for k = 50, s* 1, M-{s*) is extremely 
small. Note one can show that 7W(s) = |(^i(s)|?^init|^o(s)|/s for s G (0,10 Thus, for our initial Hamiltonian, 
A4{s) measures the overlap of the states with one single bit flip, and in this case it is extremely small. Observe 
that the position of the minimum spectral gap s* is not the same as the position s' where is maximized. 
What should be the appropriate formulation of ART? Should it be ART3? If so, under what condition, can ARTi 
be a good approximation to ART3? and under what condition, can we assume that gmm is the dominating factor 
(as have been assumed by all other works)? 



^X(s) = \{Ei{s)\nil) - HiO)\Eois)\ = (gi(s)| ^<''';'"'°' |go(g) = \{Ei{s)\niO)\Eo{s)\/s. See |81 for more details. 
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1.33e-01 


5.41e-01 


3.08e+01 


2.68e+02 


8.24e+03 


30 


0.83962780 


1.08e-01 


4.43e-01 


3.82e+01 


2.69e+02 


1.02e+04 


40 


0.88050519 


8.82e-02 


3.93e-01 


5.05e+01 


2.69e+02 


1.36e+04 


50 


0.90581875 


7.39e-02 


3.63e-01 


6.64e+01 


2.69e+02 


1.79e+04 



where g{s) = Ei{s) - Eq{s), and s' = arg maxo<^<i 



Table 1: ARTi, ART2, ART3 for T-Lk in Eq.Q. Observations: (1) g^m increases as k increases from 1 to 10, 
but decreases from 10 to 50. (2) ARTi, ART2, and ART3 are close for k < 5. (3) The matrix element A4{s*) 
at the position of minimum spectral gap is extremely small for k > 30. (4) For k > 10, s* (the position of the 
minimum spectral gap) is different from s', where s' = arg maxg<^<i Note that ARTi, and ART3 are 

close, in particular, they coincide for small k < 5. 

6 Adiabatic Algorithms for Exact Cover and 3SAT Based on the Reduction to 
MIS 

In this section, we first recall the Exact Cover problem, and then explain the special case of Exact Cover as 
the positive- l-in-3S AT, also called EC3, for which the adiabatic algorithm was first proposed for. The problem 
Hamiltonian of the proposed adiabatic algorithm for EC3 or the general 3SAT (see, e.g., |T4', '245) is based on 
the cost function which computes the number of clauses violated. This form (i.e. clause- violation cost function) 
of problem Hamiltonian has been adopted (there are two slightly different forms) by all the existing work. In the 
following, we describe different problem Hamiltonians for Exact Cover and 3SAT that are based on the reduction 
to MIS. We then point out that the argument that the clause- violation cost function based problem Hamiltonian 
(and thus the adiabatic algorithm) for Exact Cover [2| has exponential small gmm (and thus require exponential 
time) does not apply to the MIS reduction based problem Hamiltonian. 
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6.1 Exact Cover 



Formally, the Exact Cover is as follows: 

Input: A set of m elements, X = {ci, C2, . . . , Cm}', a family of n subsets of X, S = {81,82, • • . , 8n}, 
where 8i C X 

Question: Is there a subset / C {1, . . . , n} such that Uig/5j = X, where 8i n 5j = for i ^ j ^ II 
Here {S'i : i G /} is called an exact cover of X. 

Example. X = {01,02,03,04,05}, and 5 = {S*!, 52, . . . , ^7}, with 5i = {01,02,04}, ^2 = {01,02,05}, 
5*3 = {oi,03,04},5'4 = {02,03}, 55 = {03}, 56 = {04,05}, 57 = {05}. Here {51,55,57} is the exact cover of 
X. 

In particular, if we further restrict that each element Cj G X appears exactly in three subsets. The problem is 
referred as ECS, which can then be polynomially reducible to the positive l-in-3SAT problem: 

EC3 <p positive l-in-3SAT. Given an instance of EC 3 with an m-element set X and n subsets 5i, 5„, 
we construct a 3CNF boolean formula '^{xi , ■ ■ ■ , x„) = Ci A . . . A Cm with n variables and m clauses. Associate 
each set 5, with a binary variable Xj. For each element Oj G X, let 8i^, 8i^, 8i^ be the three sets that consist 
of Oj. Define the corresponding clause Ci = Xi^ V Xi^ V Xjg. Then if is clear that there is an exact cover to the 
original problem if and only if the formula '^{xi, . . . , Xn) = Ci A . . . A Cm is satisfiable in that there is exactly 
one variable in each clause is satisfied. 
The cost function 

m 

{x\ , . . . , Xri) — ^ ^ (■^ii ~l~ ■^i2 ■^*3 ^) ■ 
i=l 

penalizes each violating clause. ^ is satisfiable if and only if the minimum of <5,j, is zero (i.e. no violation). 
The corresponding problem Hamiltonian based on this penalty function as used by Altshuler et al.LU (and 
Young etal. 123)0 

'Hay= y1 E ^^^■^'^l 

iev(GEc) ijeE(GEc) 

where Bi is the number of clauses that contains variable xi, and Iij is the number of clauses that contains both 
Xi and Xj, and V(Gec) = {1, • • • , n}, and E(Gec) = {ij ■ and xj appear in a clause.}. 
Next, we show the polynomial reduction from Exact Cover to MIS : 

Exact Cover < p MIS. Given an instance of Exact Cover with an m-element set X and n subsets 5i , . . . , 5„, 
we construct a graph Gm with n vertices, where vertex i corresponds to the set 5^. The weight of vertex i is 
the number of elements in 5j. There is an edge between two vertices if and only if 5j and 8j share a common 
element. Thus, there is an exact cover to the original problem if only if the weight of mis(GM) is rn. 

For EC3, it is easy to see that Gec and Cm are exactly the same because there is one-one corresponding 
between the variable Xj and the set 5j (V(Gec) = V(Gj\/)), and "xj and Xj appear in a clause" is equivalent 
to "5j and 8j share a common element" (E(Gec) = E(GAf )). Based on this reduction, we therefore have the 

''The sign of af term is in opposite because they use Xi = instead. lij was called Jij{= ^{Jij + Jji)) in Bl)- 
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following problem Hamiltonian for the same problem: 



E E Jij-'^Bi/k\a^+ Yl ■^^o^t'y^ (7) 

*eV{GEc) \ienbr{i) / iieE(GEc) 

where Jy > mm{i?j, Bj}, and A; > 1. 

See Appendix A for an example on how to reduce ECS (given as a 3SAT problem) to a MIS problem. As 
pointed out by Young |T7|, T-Lay and T-Lc are the same for the special case Jij = 2/jj. However, our model 
is much more general since the Jij can take any values provided only that Jij > m.m{Bi, Bj}. Recall that 
2Bi = J2jenbr{i) ^ij- particular, for some ij G E(G), Jij > 2/jj (e.g. I23 = 1 but J23 > 3 in the example of 
the Appendix). 

In |2|, Altshuler et al. claimed that the adiabatic quantum algorithm with problem Hamiltonian JLay failed 
with high probability for randomly generated instances of EC3. They claimed that the correctness of their argu- 
ment did not rely on the specific form of the problem Hamiltonian for Exact Cover, but only depended on the 
properties of the problem instance Bi and ly . However, our problem Hamiltonian JLc challenges the generality 
of their claim. Their argument requires computing the energy difference Ei2{s) which depends on the energy 
function of the problem Hamiltonian. While the energy function for JLay only depends on Bi and lij, the energy 
function for JLc also depends on Jij (and/or k) whose values have a range to choose]^ 

We would like to emphasize here we point out that the argument in |l2l does not carry over to this new 
adiabatic algorithm for the same problem (EC3). That means that we can not use their argument to claim that 
our new algorithm requires exponential time. Whether this algorithm requires polynomial or exponential time 
will require rigorous analytical analysis of the algorithm. In [26], Young et al. used QMC to show that ^fmin of 
adiabatic algorithm based on the same problem Hamiltonian Hay is exponentially small. It will be interesting 
to see the gm\n result (for the same set of instances) using this new problem Hamiltonian Tic- 

6.2 3SAT 

Similarly, for 3SAT , there is a well-known reduction to MIS (which is one of the first NP-complete reductions, 
to show the NP-hardness of MIS) \j5l . For completeness, here we recall the reduction: 

3SAT <p MIS. Given a 3SAT instance ^'(xi, . . . , Xn) = Ci A . . . A Cm with n variables and m clauses, we 
construct a (unweighted) graph Gsat as follows: 

• For each clause Ci = yi-^ V yi^ V yi^, we construct a triangle with three vertices labeled accordingly, i.e., 
with yi^ , yi^ , yi^ , where yj G {xj, xj} . Therefore, Gsat consists of 3m vertices. 

• There is an edge between two vertices in different triangles if there labels are in conflict. That is, for i ^ j, 
isjt G E(Gsat) if and only if yi^ = yj;. 

One can then show that ^ is satisfiable if and only if Gsat has a MIS of size m. See e.g. |[T0| for an example. 

^For example, using Hay, the 2nd order correction E^^ ^ = — X]"=i ^/ Bi (which results — 0). But using T-Lc, we have 

-Si^^ = -(I]{i:a;.=Q} l/(-Bi - Y^{j^„br(i):xj=i} ^'j) ~ J2{i:xi^i} ^ / ^i) wMch also depends on the flexible parameter Jij (assume 
k = \) and the neighbomood of i. Here £'12 (and other higher term corrections) depend on the connectivity of the graph, and the non- 
random choice of Jij. The argument in Altshuler et al. that "Ef2 is given by a sum of 6{N) random terms with zero mean" no longer 
applies here as Jij are not random. 
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7 Discussion 



In this paper, we have shown that by changing the parameters in the problem Hamiltonian (without changing the 
problem to be solved) of the adiabatic algorithm for MIS on CK graphs, we prevent the FQPT, that causes the 
exponential small gm\n, from occurring and significantly increase ^min- We do so by scaling the vertex- weight of 
the graph, namely, multiplying the weights of vertices by a scaling factor. In order to determine the best scaling 
factor, we raise the basic question about what the appropriate formulation of adiabatic running time should be. 

We also describe adiabatic quantum algorithms for Exact Cover and 3SAT in which the problem Hamiltonians 
are based on the reduction to MIS. Notice that the reduction requires only the solution to be preserved, i.e. there is 
a polynomial time algorithm that maps the solution to the reduced problem to the solution to the original problem 
and vice versa (see e.g. [10]). In other words, the reduction might only preserves the solution (i.e. the ground 
state) and alter the energy levels of the problem Hamiltonian. As we demonstrate in our small examples, the 
minimum spectral gap can be increased drastically when the excited energy levels are changed. By definition, 
NP-complete problems can be polynomial reducible to each other. Different reduction gives rise to different 
problem Hamiltonians, and thus different adiabatic algorithms, for the same problem. At the risk of stating the 
obvious, it is not sufficient to conclude that a problem is hard for adiabatic quantum computation/optimization 
by showing that there exists an adiabatic quantum algorithm for the problem (e.g. for a particular problem 
Hamiltonian) that requires exponential time. There are three variable components, namely, initial Hamiltonian, 
problem Hamiltonian and evolution path, in order to specify an adiabatic algorithm. To prove that adiabatic 
quantum computation (optimization) fail to solve a particular problem in polynomial time, one requires to prove 
that no polynomial-time adiabatic (optimization) algorithms for the problem is possible, which is in general hard. 

In ||23l l24l . van Dam et al. argued that adiabatic quantum optimization might be thought of as a kind of 
"quantum local search", and in [24], they constructed a special family of 3SAT instances for which the (clause- 
violation cost function based) adiabatic algorithm required exponential tim^ Our CK graphs were designed to 
trap local search algorithms in the sense that there are many local minima to mislead the local search process. 
From DeSEV on a 15-vertex CK graph, we see that indeed this is the case for Hi and the adiabatic algorithm 
would require exponential time due to the exponential small gm\n caused by the FQPT or the level anti-crossing 
between the global minimum and the local minima. However, for T-Lk (say k = 10), the FQPT no longer occurs 
and (7min increases significantly, which might suggest the possibility of exponential speed-up over T-Li. It remains 
challenging on how to analytically bound ^min and/or ART of the adiabatic algorithm for T-Lk on general CK 
graphs. 
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Figure 2: DeSEV (only the 7 lowest energy levels shown) of the ground state of the MIS adiabatic algorithm 
with Til in Eq.Q as the problem Hamiltonian for wb = 1-5 (left) and wb = 1-8 (right). The x-axis is the time 
s. The y-axis is the (-)energy level. Each color corresponds to an energy level. The correspondence between 
(-)energy levels and the states are shown. The z-axis is T. As time s increases, one can see how T of each energy 
level evolves to get some sense of the evolution. For example, for wb = 1-5 (left), for the (-)energy level 6 
(which corresponds to the solution state), shown in brown, F changes from almost at s = 0.2, to more than 0.4 
at s = 0.4, to almost 1.0 at s = 0.8. For wb = 1-8 (right), F of (-) energy level 6 changes from almost before 
s = 0.6 to more than 0.9 at s = 0.7; while F of (-) energy level 5.4, which corresponds to the local minima, 
gradually increases from s = to 0.6, but almost after s = 0.6. 
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(Zoom:s = 0.627 ... 0.628) 
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Figure 3: DeSEV of the ground state and the first excited state of the MIS adiabatic algorithm with T-Li in Q 
as the problem Hamiltonian for wb = 1-8 (a) s = ... 1; (b) Zoom in s = 0.627 . . . 0.628; (c) The lowest two 
energy levels of '?^(s), s = . . . 1. The inset illustrates a level anti-crossing between two states \B) and |^), or 
the system has a FQPT from \B) to |^) at the anti-crossing s*. In this example, \ A) = !••••• •) + !••• ••) 

and \B) = |AZW\ZW\) + |AAZW\) + lAAA). 
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Figure 4: DeSEV of the ground state and the first excited state of the MIS adiabatic algorithm with problem 
Hamiltonian Tii (left) and Tiio (right) where wb = 1-8. Notice the differences in the lowest few excited states. 
For k = I, the 2nd and 3rd excited states are superpositions of As (vertex in Vb which constitutes the local 
optima); while for A; = 10, the 2nd and 3rd excited states are superpositions of ws (vertex in Va which constitutes 
the global optimum). As a result, the first order phase transition from local minima to global minimum occurs 



for k - 
and^n 



1, which results in the 



1.04 X 10 at s* = 0.627. For k = 10, such crossing no longer occurs. 



0.145 at s* = 0.667. See Figure[5]for the zoom-in. 
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Figure 5: Zoom around s*. 
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Figure 6: DeSEV of the ground state and the first excited state of the adiabatic algorithm with problem Hamil- 
tonian "H^ for wb = 1-8, where k = 1,2, 3, 5, 10, 50. 
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Appendix A. 

Example: EC3 <p MIS. Let ^'(xi, . . . , X7) = Ci A C2 A C3 A C4 A C5 be an instance of EC3 with 7 
variables and 5 clauses: 

• Ci = xi V X2 V X3, C2 = xi V a;2 V X4, C3 = X3 V X4 V X5, C4 = xi V X3 V Xe, C5 = X2 V xg V xy. 
For each variable Xj, let be the set consisting of all clauses in which x; appears. That is, we have 

• Si = {Ci, C2, C4}, 52 = {Ci, C2, C5}, 5*3 = {Ci, C3, C4} 
. 54 = {C2, C3}, S5 = {Cs}, Se = {C4, C5}, 57 = {C5} 
Construct the graph Gec as follows: 

• V(Gec) = {1> 2, . . . , 7}, where vertex i corresponds to the set Si, and the weight of vertex i is the number 
of elements in Si {=Bi); 

• E(Gec) = {ij '■ Si and Sj share a common clause }. 

See Figure [7] It is easy to see that Gec has a MIS of weight 5 if only if is satisfiable (in positive l-in-3SAT 
sense). 




Figure 7: The number next to the vertex is the weight of the vertex. mis(GEc) = {1, 5, 7}, with weight 5. 
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Table 2: The minimum spectral gap ^fmin (and position s*) changes as wb changes from 1 to 1.9, for the (unsealed) 
problem Hamiltonian Hi in Eq.Q. 
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